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ABSTRACT 

This paper discusses an instrument developed to 
evaluate the characteristics of the major innovative elementary 
school science curriculum projects* .The purpose of this 
Ealf-assessment instrument is to determine which project is best for 
a particular school or classroom. The instrument does not attempt to 
coi^are one project with another and allows for the unique approach 
of each project. . It is made up of nine categories each further 
divided into sub ""key points** to provide a more detailed and 
comprehensive rating of each category • . The categories include: (1) 
objectives and philosophy of school and project, (2) student-material 
interaction, (3) individual differences, (4) teacher training 
(inservice), (5) integration of ccmceptual schemes, (6) learning 
activities, (7) evaluation provisions, (8) cost of project, and (9) 
organizaticm of project*. The instrument has been presented to 
undergraduate students in an elementary science methods course, 
graduate students with teaching e^erience, and elementairy school 
teachers for suggestions, revision and validation. It will be further 
revised and tested in several elementary schools becoming available 
for school use. (JR) 
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\JLi NEED : A proposal for an instrument to assess programs In secondary school 
science was stated In NSTA*s Life Members Breakfast "Info Memo" of April 9, 
1972. The need for such an instrument Is even greater at the elementary 
I school level since at this time there Is no comprehensive rating-guide which 

can be used to evaluate the numerous characteristics of the major elementary 
science Curriculum projects such as SCIS, ESS or Science - A Process Approach. 
Even more crucial is the need for an instrument which ca.i be used by elementary 
school teachers and administrators who are either working with a program, or 
are In the process of selecting one for their particular school or classroom. 
Questions such as "Haw good are these new programs?" or "What program would 
be best for our classrooms?" are the realistic questions which confront the 
teacher or principal who Is in the process of evaluating one or more of the 
projects. 

PURPOSE: The purpose of the self-assessment instrument is to assist In 
determining which project is best for a particular school or classroom. The 
instrument is also designed to help in the evaluation of a particular science 
program. Thi^ latter point will be discussed later on In the paper « The 
instrument Is not intended for comparing one project with another. It allows 
for the uniqueness In approach and the differences in purposes of each project. 

DESIGN; The format for the instrument was modeled after Suyoam (1968) who 
^ developed an Instrument for evaluating experlmentitl research reports in 

^ mathematics education. The content for this instrument was synthesized from 

>^ the following three sources: 
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1. the questions developed for evaluation of a science curriculum 
outlined In "Science for the Seventies," an elementary science 
program developed by the Pennsylvania Department of Education (1970) 

2. a checklist for assessing a science progran, prepared by U.S.O.E. In 
1964, (U. S. Office of Education), and 

3. a description of some characteristics of a good elementary school 
science program from Rethinking Science Education , N.S.S.E.'s 59th 
Yearboolc, (National Society for the Study of Education) 

Items included under each question as 'Icey points" were characteristics 
repeated by Andrews (1969). Brehm (1970, and Hurd and Gallagher (1968). 

The instrument is made up of nine categories - each represented by a 
question and further divided Into sub "key points" to provide for a wore 
comprehensive rating In each category. The nine categories Include: 

1. Objectives and philosophy of project and school 

2. Student-material interaction 

3. Individual differences 

k. Teacher training and In-service 

5. Integration of conceptuaJ-^hemes 

6. Learning activities 

7. Evaluation provisions 

8. Cost of project 

9. Overall organization and presentation of project 

The actual rating is based on a five point scale %*ich Is explained on 
the first page of the instrument. 

DISCUSSION OF DESIGN ; A review of several articles on the new science 
curricula stressed t^ need for goal definition. Hurd (1969) points out that 
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many terms such as discovery, process and inquiry are not clearly defined and 
that some programs have labels that are not clearly understood. He states that 
the new labels serve mere as slogans instead of indicating educational prac- 
tice and that it is difficult to distinguish performance taught under one 
label or another. If the same could be said for the elementary school programs, 
then it can be suggested that an evaluation of^the programs would have to 
involve value Judgements. Evaluation is a value-weighted interpretation of 
goats, objectives, subject matter, teachability and tearni>}tity of materials, 
and costs in time and effort. Should an instrument for evaluating elementary 
science progrMis allow for such subjectivity in the selection of a project? 

The instrument presented here provides only a fr^Rework from which one 
determines which program is be^t for a particular teacher or school* This 
then means a clear definition of one's goals of teaching is needed* Andrews 
(1969) supports this when he states that in using the guidelines he developed 
for examining new curricula a careful definition of one's goals for science 
instruction is necessary. The same vias recently implied in the December 1972 
issue of Science and Children by members of the Science Education Center (1972) 
at the University of Olclahoma in their list of criteria for evaluating elementary 
school science curricula. They state that "someone else's purposes for teach- 
ing science In the elementary schoo^ need not be the same as oursj' The N.S.S.E. 
went a step further in their 59th Yearboolc by stating that a program In elemen- 
tary science can be effectively evaluated when the objectives of the program 
are clear and have been accepted by the teachers and administrators. Fish (1971) 
also recognized the agreement between the stated goals of the curriculimi and 
the goats of the school or teacher, "basics, "Are these the goats we want?" 

It Is hoped that consideration of goal definition wi It diminish any bias 
to one philosophical viewpoint by any one of the projects. To add to the 
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comprehensiveness of the Instrument, course content validity, pedagogical 
validity, and social and philosophical validity were also considered. These 
terms were deflr^id by Hurd (1969) and mre also considered in developing the 
"Icey points" of the instrument. Hurd and Gallagher (1968) did not raise the 
question of cost because ••human resources are always more critical than 
financial resources." Realizing, however, that any acfaninistrator would asic 
'•how muchT*^ the question of the project's cost %#as included in the Instrument. 

Recent findings from some of our more contemporary psychologists as 
well as the influence of the psychology of child development also provided 
many of the "key points" for the questions dealing with learning activities 
and child participation. 

PROCEDURE: The instrument has been presented to the following groups: 

1. Approximately 75 undergradua*-^ students in elementary science 
methods classes for discussion, clarification and suggestions. 

2. A group of 28 master degree and doctoral students in elementary 
education with teaching ^experience for revision and validation. 

3. A summer worlcshop In elementary science for further discussion, 
clarification and rewriting, and 

4. A group of 25 K-3 elementary teachers In the State College, 
Pennsylvania, area school district for use in evaluating their 
SAPA program. 

USING THE iWSTRUHENT : From those who have used the Instrument to review one 
or more of the science projects. It was mentioned that the model Is quite 
comprehensive and representative of the many criteria used in examining a 
curriculum. It becomes apparent after using the instrument with several pro- 
Ject$ that "the best one*' Is the one satisfying the goals of both the teacher 



and the school district. Also, the Instrument provides the reviewer the 
necessary framework from fcfhich he can clearly distinguish between the needs 
of the children from his own. For example, questions 1, 7, and 8 reflect 
teacher concerns while questions 2, 3, 5, 6, and part of 9 are directed 
toward the child's needs and the learning process. 

The total score of the assessment Is not as important as the Individual 
scores for each question unless the projects are quite different In their 
goals, organization and content. It has been suggested ♦^hat the individual 
using the instruHwnt rank the questions In a priority that reflects the 
particular needs of his class or the school. For example, a principal may 
feel that questions 3 and 8 are of higher priority because of the grouping 
in his school and his limited budget. Another school system may place emphasis 
on questions I and k If the selection committee feels that teachers would like 
the program If they had proper presentation to the project and adequate train- 
ing. It Is therefore suggested that decisions be made on what Is ii^rtant 
to the teacher or the school before the program is finally evaluated. 

The Instrument can take from 20 minutes to one hour to use depending on 
the evaluatoris knowledge of the program being considered, familiarity with 
the Instrument and the number of people Involved in the decision making process 
If the Instrument is being used to select a project then several sessions may 
be needed to examine the materials, manuals, texts, etc. of the program. The 
Instrument can also be used for discussion purposes. Hany teachers using the 
Instruments* the questions or "key points" could be used in asking questions 
about the program or In talking with the project's representative. 

The instrument has been designed to be flexible and yet provide some 
organlzatlor for decision making. It can be used in Its entirety or In part. 
In both formal and Informal situations, and by one person or by a group. It 



can be used to select a project or evaluate one* It was designed to assist 
you - the one who is in a position to malce the decision* 
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AN INSTRUiiEilT FOR ASSESSING ELEMBiTARY SCIENCE CURRICULUM PROJECTS* 



George P. Toth 
The Pennsylvania State University 

Directions: 

This self-assessment instrument Is based on the nine underlined 
questions which follow. The quality of the program (project) in terns 
of each question is rated on a five-point scale. Certain "key points 
should be constdered in determining a rating for each question. These 
are listed below the question, followed by adjectives which indicate tlie 
contintfc on which the "key point" should be assessed. DO HOT make a 
response to these "key points." They are intended to focus the atten- 
tion of the rater(s) .n the same pertinent aspects of each question. 
The specifications fot these five points are: 

none or too few of the "key points" 
are met 

a few "key points" are met 

some "key points" are met 

most "key points" are met 

all "key points" for the question are 
met; nothing essential could be 
added 

Please make only nine responses for each project, one for each 
question. Responses may be noted by circling the appropriate value 
on the five-point scale following each question. 

*Modeied after: Suydam, M. "An Instrument for Evaluating Experimental 
Educational Research Reports." The Journal of Educational Research, 
January 1968. 
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Poor: 
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Fair: 
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Good: 




Very good; 
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Excel lent: 
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An Instrument for Assessing Elementary Science Curriculum Projects 



1. How adequately do the purposes and objectives of the project agree 
With yours oir the schooFs? (5"-*-i-2-U 



a* Goals 

1 • Real 1 ife values 

2. Modern learning theory basts 

b. Project's philosophy 

c« Teacher enthusiasm for program 



(relevant— irrelevant) 

( rel evant" I r rel evant> 

(current—out-dated) 

(clear—unclear) 

(agree—disagree) 

(interested—not- interested) 

(mot I vated—not-mot i vated) 



2. How sufficient are the supplied materials for student-material inter- 
act Ion? (5-^-2^ 



a. Student materials (equipment) 



b. Student materials (printed) 
1 • Textbook 

2. Workbook 

3. Wbrksheets 

c. Manipulation 

d. Storage raquirements 

e. Lea rn I ng* teaching aids 

f. Teacher preparation 



(ava i I ab 1 e"maya liable) 
(sufficient— insufficient) 
(o rde red" I mp r o V i sed ) 

(a va 1 1 ab 1 e—unava liable) 
(ava I 1able--unava liable) 
(ava II ab 1 e"unava liable) 
( reasonab I e~un reasonab 1 e ) 
( rea sonab 1 e**y n reasonab 1 e ) 
(suitable-^unsui table) 
(essent i a 1 — non-essen t i a 1 ) 



3. How adequately does the program provide for all children? (5-^-3-2-1) 



a. Provisions for individual differences 
K Development of gifted student 
2. Consideration for below average 

b« Pacing of Instructional materials 

c. Provisions for successful achieve- 
ment 

d. Provisions for cultural differences 



(spec I f I ed~unspec 1 f i ed) 
( spec I f i ed— unspec I f 1 ed ) 
(adequate— i nadcqua te) 

(noted—not -noted ) 
(spec I f I ed*-unspec I f 1 ed ) 



How adequate are the provisions for teacher training? (5-^*3*2-1 ) 



a. Consulting service 

b. In-service programs 

c. Recency of teacher •$ science back- 
ground 

d. Printed materials for teachers 
K Manuals 

2« Reference books 

3. Newsletters, periodic reports 



(ava 1 lable— unava 1 lable) 
(aval lab 1 e—unava 1 lable) 

(Important— not- Important) 

(aval lable—unavai lable) 
(ava i I ab 1 e—unava 11 abl e ) 
(ava i lable— unava I table) 
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How appropriately integrated are tho broad conceptual themes? (5-^-3-'2-l ) 



c. 
d. 



Content 

!• Grade level 

2. Biological » physical, and earth 
sciences 

3 • Sequence 

Historical, biographical and 
philosophical aspects of science 
Social utility issues 
Coordination with mathematics 
Provision for development of process 
skills 



(specified—unspecified) 
(flexible—rigid) 

(ba 1 anced— unba f anced) 
(related—unrelated) 
(clear— unclear) 
(logical — illogical) 

(emphas i zed— unemphas i zed ) 
(cmphas i zed— unemphas i zed) 
(related— unrelated) 

(extensive— 1 i mi ted) 



How reasonably are the children involved in the learning activities? 



a. Purpose of activity 

b. Opportunities for independent work 

c. Opportunities for open-ended and 
problem-solving activities 



d* Variation in activities 

Provision for out-of-c lass room work 
f. Integration with learnings 



(important— not- important) 
(clear— unclear) 
(extensive— 1 imited) 

(suf f i c i en t— i nsu f f i c i en t ) 
(emphas i zed— not -emphas I zed) 
(appropr i ate— i nappropr late) 
(sufficient— insufficient) 
(noted— not-noted) 
(sat i sf actory— unsat i sf actory) 



How proper are the instruments for measuring student performance and 
eva luatlng tKe project? 15-4-3^11 



a. '"echniques or instruments 

1. Performance tests 

2. Rating scales 

3. Teacher-made tests 

b. Criteria for projcc.t evaluation 

c. Evidence of project evaluation 

1. teacher comments and reactions 

2. pupil comments and reactions 

3. i»idcrstandlng of concepts 
k. observation of students 

5. fei*dback processes 

6. control groups 

7. sample (test population) 



(aval 1 able— unavailable) 
(aval 1 able— unavailable) 
(necessary-unnecessary) 
(avs i 1 ab 1 e— una va liable) 

( reported— not- repo r ted) 
( reported— not- reported) 
(pre- test— post-test) 
( repo r ted— not - repo r ted ) 
(spec i f i cd— unspec I f I ed) 
(noted— not-noted) 
(appropr I ate-* i nappropr 1 ate) 
(random—unspec I f led) 
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How practical or reasonable is the cost of the project? 

a. Initial cost per class of 30 

b. Annual cost per class of 30 



c. Additional facilities or equipment 

d. Teacher training 

e. Textbooks 

f. Storage requirements 

g. Materials 

How adequatel y is the project presented? 

a. Organization 

b. Style, design 

c. Visual aids 



(noted— not-noted) 
(reasonable — unreasonable) 
(noted~not-notcd) 
( reasonab I e — ^not-notcd) 
(requi red — not-requi red) 
(prov i ded— not-p rov i ded ) 
(necessa ry— -opt i ona I ) 
( lmportant-*not* important) 
(permanen t — expcndab I e ) 



(excel lent— poor) 
(logical — i I logical ) 
(attract i ye— unatt ract I ve) 
(appropr iate— i nappropr i ate) 
(appeal lng*-unappeal ing) 
(appropr i ate— i nappropr f ate) 



